Information processor, audio processor, audio processing system and program

ABSTRACT

An audio processor acquires processed sound data, which is obtained by processing original sound data according to a content of processing defined such that first sound is emitted under the standard sound emission condition, in association with a sound emission device, acquires a control signal, and acquires a device sound emission condition. In order to make second sound emitted by the sound emission device under the acquired device sound emission condition close to the first sound, the audio processor identifies the correction content of the processed sound data based on a difference between the device sound emission condition and the standard sound emission condition, the control signal, and the processed sound data acquired in association with the sound emission device. The audio processor corrects the processed sound data according to the correction content, and supplies the corrected processed sound data to the sound emission device.

This application is a U.S. National Phase Application of PCTInternational Application PCT/JP2011/069649 filed on Aug. 30, 2011,which is based on and claims priority from JP 2010-192968 filed on Aug.30, 2010 the contents of which is incorporated in its entirety byreference.

TECHNICAL FIELD

The present invention relates to an audio processing technique whencontents, such as video game software, are expressed using a computer.

BACKGROUND ART

As video game software (hereinafter, referred to as video game software)which is executed by a specialized video game machine (hereinafter,referred to as a video game machine) with an embedded computer, apersonal computer, or the like, there is video game software whichexpresses a three-dimensional space or reproduces a motion image inaccordance with the progress of the video game. There is also areproducer which reproduces video content recorded in a commerciallyavailable DVD (Digital Versatile Disc) video, Blu-ray (RegisteredTrademark) disc video, or the like (hereinafter, referred to as DVDvideo or the like) in accordance with user operation.

A video game machine which executes video game software or a reproducerwhich reproduces video content is an information processor whichperforms information processing. In general, the information processoris connected to an amplifier including a sound emission device, such asa speaker, and transmits a sound signal to the amplifier such that soundis synchronized with video of the content. Although many informationprocessors mix sound such that a sound field is formed in accordancewith the standard audio environment defined in advance over all contentsand then transmit the sound to the amplifier, an information processorwhich changes a sense of sound field in accordance with the progress ofa content to obtain a sense of reality or a sense of strong impact hasbeen developed. For example, Patent Literature 1 discloses a techniquewhich switches the effects of reproduced sound in accordance with theprogress of a video game.

CITATION LIST Patent Literature

Patent Literature 1: JP-A-8-243254

SUMMARY OF INVENTION Technical Problem

However, according to the technique of Patent Literature 1, while thesound field changes when the conditions relating to the progress of thevideo game are satisfied, there are various kinds of sound, such asoperation sound, ambient sound, and BGM (background music), and the samesound field is applied to the plurality of types of sound withoutexception based on standard sound emission conditions. For this reason,in the technique of Patent Literature 1, the desired sound effect is notobtained depending on the type of sound or the sound emission conditionswhen reproducing under actual sound emission conditions.

An object of the invention is to emit predetermined sound under actualsound emission conditions of a sound emission device by means ofprocessed sound data processed based on standard sound emissionconditions.

Solution to Problem

In order to solve the problem as mentioned above, an audio processoraccording to the invention is an audio processor for being connected toa sound emission device that emits a sound according to supplied data,the audio processor including: a processed sound data acquirer that isadapted to acquire processed sound data, which is obtained by processingoriginal sound data according to a content of processing defined suchthat determined first sound is emitted under a standard sound emissioncondition as a predetermined sound emission condition, wherein theprocessed sound data is acquired in association with the sound emissiondevice; a control signal acquirer that is adapted to acquire a controlsignal including at least one of a parameter indicating the content ofprocessing on the original sound data and information indicating aconfiguration of processed sound data obtained by processing theoriginal sound data by means of the parameter; a sound emissioncondition acquirer that is adapted to acquire a device sound emissioncondition as a sound emission condition for the sound emission device;an identifier that is adapted to identify a correction content of theprocessed sound data based on a difference between the device soundemission condition and the standard sound emission condition, thecontrol signal acquired by the control signal acquirer and the processedsound data acquired in association with the sound emission device by theprocessed sound data acquirer in order to make a second sound, which isemitted by the sound emission device under the device sound emissioncondition acquired by the sound emission condition acquirer, close tothe first sound or a third sound defined to be different from the firstsound; a corrector that is adapted to correct the processed sound dataaccording to the correction content identified by the identifier; and asupplier that is adapted to supply the processed sound data corrected bythe corrector to the sound emission device.

Preferably, an identification information acquirer is included that isadapted to acquire identification information of the original sounddata, and the control signal acquirer is adapted to transmit theidentification information of the original sound data acquired by theidentification information acquirer to an external device, and toacquire the control signal including at least one of the parameter ofthe original sound data indicated by the identification information andinformation indicating a configuration of processed sound data obtainedby processing the original sound data by means of the parameter from theexternal device.

Preferably, a transmitter is included that is adapted to transmit asignal indicating the device sound emission condition acquired by thesound emission condition acquirer to an information processor causingthe processed sound data acquirer to acquire the processed sound data,and the supplier supplies uncorrected processed sound data to the soundemission device without a correction of the processed sound data by thecorrector when the processed sound data acquired by the processed sounddata acquirer is a processed sound data which is obtained by processingthe original sound data according to the content of processing definedsuch that the first sound is emitted under the device sound emissioncondition indicated by the signal transmitted by the transmitter.

An information processor according to the invention includes: agenerator that is adapted to generate original sound data indicatingoriginal sound and a parameter indicating a content of processing on theoriginal sound data in accordance with user operation; a processed sounddata generator that is adapted to process the original sound datagenerated by the generator according to the content of processingindicated by the parameter to generate processed sound data; a processedsound data output section that is adapted to output the processed sounddata generated by the processed sound data generator from any channel ofa plurality of channels; and a control signal output section that isadapted to output a control signal including at least one of theparameter indicating the content of processing on the original sounddata and information indicating a configuration of processed sound dataobtained by processing the original sound data by means of theparameter.

An audio processing system according to the invention includes: theaudio processor as mentioned above and the information processor asmentioned above.

A program according to the invention is a program which causes acomputer, for being connected to a sound emission device that emits asound according to supplied data, to function as: a processed sound dataacquirer that is adapted to acquire processed sound data, which isobtained by processing original sound data according to a content ofprocessing defined such that determined first sound is emitted under astandard sound emission condition as a predetermined sound emissioncondition, wherein the processed sound data is acquired in associationwith the sound emission device; a control signal acquirer that isadapted to acquire a control signal including at least one of aparameter indicating the content of processing on the original sounddata and information indicating a configuration of processed sound dataobtained by processing the original sound data by means of theparameter; a sound emission condition acquirer that is adapted toacquire a device sound emission condition as a sound emission conditionfor the sound emission device; an identifier that is adapted to identifya correction content of the processed sound data based on a differencebetween the device sound emission condition and the standard soundemission condition, the control signal acquired by the control signalacquirer and the processed sound data acquired in association with thesound emission device by the processed sound data acquirer in order tomake a second sound, which is emitted by the sound emission device underthe device sound emission condition acquired by the sound emissioncondition acquirer, close to the first sound or a third sound defined tobe different from the first sound; a corrector that is adapted tocorrect the processed sound data according to the correction contentidentified by the identifier; and a supplier that is adapted to supplythe processed sound data corrected by the corrector to the soundemission device.

Advantageous Effects of Invention

According to the invention, it is possible to emit predetermined soundunder actual sound emission conditions of a sound emission device bymeans of processed sound data processed based on standard sound emissionconditions.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram showing the configuration of an audio processingsystem according to an embodiment of the invention.

FIG. 2 is a diagram showing the configuration of a video game machine.

FIG. 3 is a diagram showing the functional configuration of the videogame machine.

FIG. 4 is a diagram showing an example of a control signal generated bya control signal generation unit.

FIG. 5 is a diagram showing an example of a processed control signalwhich is transmitted from an output unit.

FIG. 6 is a diagram showing the functional configuration of a processingunit.

FIG. 7 is a diagram showing the configuration of an audio processor.

FIG. 8 is a diagram showing the functional configuration of mainly acontrol unit of the audio processor.

FIG. 9 is a table showing an example of a correction content table whichis stored in a storage unit.

FIG. 10 is a diagram illustrating the outline of correction processing.

FIG. 11 is a diagram showing an audio processing system according to amodification.

FIG. 12 is a diagram showing the functional configuration of a videogame machine according to a modification.

FIG. 13 is a diagram showing the functional configuration of aprocessing unit according to a modification.

DESCRIPTION OF EMBODIMENTS

1. Configuration

1-1. Overall Configuration of System

FIG. 1 is a diagram showing the configuration of an audio processingsystem 9 according to an embodiment of the invention. The audioprocessing system 9 includes a video game machine 1, an audio processor2, and a sound emission device 3. The video game machine 1 and the audioprocessor 2 are connected together by a multi-channel communicationcable in accordance with a standard, such as HDMI (High-DefinitionMultimedia Interface; Registered Trademark). The term “channel” means atransmission path through which data is transmitted, and the term“multi-channel communication cable” means a communication cable whichhas a plurality of separate channels. The video game machine 1 is anexample of an information processor which reproduces software orcontents. The audio processor 2 and the sound emission device 3 areconnected together by an audio cable through which an audio signal istransferred. The video game machine 1 and the audio processor 2 are ableto exchange information with each other, and while the transfer ofinformation from the audio processor 2 to the video game machine 1 canbe performed as indicated by a broken line in FIG. 1, this will beomitted in the following description of the embodiment.

1-2. Configuration of Video Game Machine

FIG. 2 is a diagram showing the configuration of the video game machine1. A control unit 11 has a CPU (Central Processing Unit), a ROM (ReadOnly Memory), and a RAM (Random Access Memory), and controls therespective units of the video game machine 1 using the CPU which readsand executes a boot loader stored in the ROM or various programs storedin a storage unit 12 on the RAM. The control unit 11 includes a decoderwhich decompresses motion images and sound data compressed in accordancewith the standard, such as MPEG2 or MPEG4, and generates uncompressedPCM (pulse code modulation) data. The decoder may be realized by aspecialized processor which is hardware different from the CPU or may berealized by the CPU which executes a program. The control unit 11functions as, for example, a video game progression unit 110, anoriginal sound data generation unit 111, or the like.

The storage unit 12 is high-capacity storage means, such as a hard diskdrive, and stores various programs which are read into the control unit11. A video game program 121 is one of various programs. The storageunit 12 may be a recording medium, such as an external nonvolatilememory. In this case, the storage unit 12 is connected to the video gamemachine 1 through a connection interface (not shown) or the like. Thestorage unit 12 may include a reader which reads a recording medium,such as an optical disk. In this case, the storage unit 12 may read arecording medium loaded in the reader, and if the recording medium isrewritable, may perform rewriting on the recording medium.

An operation unit 13 includes an operator 131 which gives variousinstructions. The operation unit 13 receives user operation and suppliesan operation signal according to the operation content to the controlunit 11.

The display unit 14 includes, for example, a display, such as a liquidcrystal display, and displays video according to the progress of a videogame under the control of the control unit 11.

An output unit 15 is an interface which sends a plurality of pieces ofsound data and control signals to the audio processor 2 such that aplurality of kinds of sound according to the progress of the video gameare emitted to the audio processor 2 under the control of the controlunit 11. The output unit 15 includes a packet processing unit 151 and aprocessing unit 152. The processing unit 152 processes sound data(hereinafter, referred to as original sound data) indicating originalsound obtained from the original sound data generation unit 111described below to generate a plurality of pieces of sound data(hereinafter, referred to as processed sound data) according to theprogress of the video game. The processing unit 152 is a processor whichperforms processing, such as mixing of original sound data under thecontrol of the control unit 11. The packet processing unit 151 dividesthe generated processed sound data in terms of audio frames as a unit ofsound reproduction, and adds a header including a time stamp indicatinga reproduction time, or the like to form packets.

The output unit 15 is connected to the audio processor 2 through themulti-channel communication cable. The communication cable has sevenchannels. A control signal is output to one channel ct from among thechannels, and the packetized processed sound data is transmitted to theremaining six channels L, R, C, SL, SR, and SW. The details of thecontrol signal will be described below.

1-3. Functional Configuration of Video Game Machine

FIG. 3 is a diagram showing the functional configuration of the videogame machine 1. The control unit 11 reads and executes the video gameprogram 121 (see FIG. 2) stored in the storage unit 12 to function asthe video game progression unit 110, the original sound data generationunit 111, and the control signal generation unit 112. The video gameprogression unit 110 progresses the video game in accordance with useroperation along the video game program 121. That is, the video gameprogression unit 110 functions as a video game progression section thatis adapted to progress the video game in accordance with user operation.Specifically, the video game progression unit 110 reads configurationinformation of the video game stored in the storage unit 12, anddetermines the progress of the video game, the allocation of theoperation signal, or the like in accordance with the configurationinformation. The video game progression unit 110 interprets theoperation signal indicating user operation received by the operationunit 13 and progresses the video game. The video game progression unit110 reads video data indicating video according to the progress of thevideo game from the storage unit 12, sends video data to the displayunit 14, and displays video according to video data on the display unit14. The video game progression unit 110 reads sound data to be used inthe video game from the storage unit 12 in accordance with the progressof the video game.

The original sound data generation unit 111 individually generatesoriginal sound data indicating original sound based on sound data readby the video game progression unit 110. The original sound datageneration unit 111 generates identification information for identifyingoriginal sound data to be generated and a time stamp indicating thetiming at which sound should be emitted in accordance with processedsound data of the original sound data in association with the originalsound data. The term “original sound” means a sound as a basis for aprocessed sound to be heard by the user of the video game in accordancewith the progress of the video game, and includes, for example, BGM,ambient sound, voice, system sound, and the like. BGM (Background Music)is music for increasing the emotion of the user. Ambient sound is sound,such as the footstep of a game character operated by the user or soundof wind and rain, which expresses a virtual space in the video game.Voice is voice of a game character which appears in the video game.System sound is sound for causing the user to recognize that theoperation unit 13 receives operation, and includes, for example,clicking sound, chime sound, and the like. The number of pieces oforiginal sound data which are generated simultaneously by the originalsound data generation unit 111 will change depending on the progress ofthe video game. Here, as shown in FIG. 4, the number of pieces oforiginal sound data which are generated by the original sound datageneration unit 111 is a maximum of five. These pieces of original sounddata are supplied to the processing unit 152 through channels ch1 toch5. The original sound data generation unit 111 functions as agenerator that is adapted to generate original sound data indicatingoriginal sound in accordance with user operation. In this case, inparticular, the original sound data generation unit 111 functions asoriginal sound data a generator that is adapted to generate originalsound data according to the progress of the video game progressed by thevideo game progression section. The identification information or thetime stamp of the original sound data may include the header of theoriginal sound data, or the like.

The control signal generation unit 112 generates a control signal whichdescribes each attribute of each piece of original sound data inassociation with the identification information of each piece oforiginal sound data generated by the original sound data generation unit111. The attribute is information which designates how original soundindicated by original sound data is heard by the user. Specifically, theattribute refers to the attribute of sound (hereinafter, referred to asfirst sound) determined to be emitted under standard sound emissionconditions (hereinafter, referred to as standard sound emissionconditions) of the sound emission device 3 connected to the audioprocessor 2, and includes, for example, the direction in which the soundis heard, reverberant sound of the sound, the sound range of the sound,or the like. The content of processing on original sound data is definedby a parameter such that the first sound is emitted under the standardsound emission conditions. The parameter indicating the content ofprocessing is defined in accordance with the progress of the video game.

The sound emission conditions are sound emission conditions which aredefined depending on the disposition or ability of the sound emissiondevice 3, and include, for example, conditions of the number of soundemission devices 3, such as speakers, the angle and distance withrespect to the listening position of the user, the sound range in whichsound can be emitted, intensity of reverberation, and the like. Thestandard sound emission conditions are conditions defined in advance for5.1 ch surround based on Dolby AC-3 (Registered Trademark), and indicatethe disposition of sound sources corresponding to six channel signals intotal of front left and right and central main signals L, R, and C, leftand right surround signals SL and SR, and a subwoofer signal SW, and thesound emission ability of a speaker which expresses each sound source.Accordingly, the control signal generation unit 112 functions as agenerator that is adapted to generate a parameter indicating the contentof processing on original sound data in accordance with user operation.In this case, in particular, the control signal generation unit 112functions as a generator that is adapted to generate a parameterindicating the content of processing on original sound data according tothe progress of the video game progressed by the video game progressionsection.

The processing unit 152 of the output unit 15 acquires the parameterfrom the control signal generation unit 112. The processing unit 152processes each piece of original sound data generated by the originalsound data generation unit 111 based on the acquired parameter, andgenerates a plurality of pieces of processed sound data. The details ofthe processing unit 152 will be described below. Here, it is assumedthat processed sound data is PCM data like original sound data.

The processing unit 152 generates information indicating theconfiguration of processed sound data obtained by processing originalsound data by means of the acquired parameter, and outputs a controlsignal (hereinafter, referred to as a processed control signal)including the information.

The packet processing unit 151 packetizes a plurality of pieces ofprocessed sound data generated by the processing unit 152, and outputsthe packets to the audio processor 2 using individual channels.Accordingly, the output unit 15 functions as a processed sound dataoutput section that is adapted to output processed sound data generatedby a processed sound data generator from any channel of a plurality ofchannels.

In order to process original sound data under actual sound emissionconditions (hereinafter, referred to as device sound emissionconditions) specific to the sound emission device 3 instead of thestandard sound emission conditions, various kinds of information in thesound emission device 3, such as the position or reproduction ability ofeach sound emission device 3 to which a connection unit 24 of the audioprocessor 2 is connected, are required. For this reason, the video gamemachine 1 processes original sound data under the standard soundemission conditions defined in advance to generate processed sound data,and the audio processor 2 corrects the generated processed sound dataunder the actual device sound emission conditions of the sound emissiondevice 3.

The packet processing unit 151 of the output unit 15 outputs theprocessed control signal generated by the processing unit 152 to theaudio processor 2 in association with the channels of a plurality ofpieces of processed sound data. The synchronization between theprocessed sound data and the control signal is made by the time stampincluded in the control signal and the time stamp used when each pieceof processed sound data is packetized. Accordingly, the output unit 15functions as a control signal output section that is adapted to output acontrol signal (processed control signal) which includes informationindicating the configuration of processed sound data obtained byprocessing original sound data by means of the parameter indicating thecontent of processing on original sound data generated by the generator.

1-4. Configuration of Control Signal and Processed Control Signal

FIG. 4 is a diagram showing an example of a control signal generated bythe control signal generation unit 112. FIG. 5 is a diagram showing anexample of a processed control signal which is generated by theprocessing unit 152 and transmitted from the channel ct of the outputunit 15. As shown in FIG. 4, the control signal describes the time stampindicating the timing at which the control signal should be applied andparameters indicating four attributes of type, localization,reverberation rate, and bit rate defined for the respective channels (ch1 to ch 5).

The type refers to the type of original sound indicated by originalsound data, and specifically includes BGM, SE (ambient sound), VO(voice), SYS (system sound), and the like. Since original sound data isidentifiable depending on the type, here, the parameter indicating thetype is used as identification information of original sound data.

The localization is the direction in which the user feels that there isa sound generation point. For example, 0 degree is the front directionof the user, and one circle to the left side (that is, acounterclockwise direction when viewed from above the head of the user)from the front direction is expressed in 360 degrees.

The reverberation rate is a value indicating the intensity ofreverberation, which is a sound effect of applying reverberation tosound such that the user feels the width of the space, and when thevolume of original sound as a basis is 100%, expresses the ratio ofvolume of reverberant sound applied to original sound in percentage. Asthe percentage is high, strong reverberation is applied, and the userfeels the width of the space.

The bit rate expresses the amount of information per second of soundincluded in original sound data with the number of bits, and indicatesquality of original sound data.

For example, in the control signal shown in FIG. 4( a), the time stampis t=0.0 second, the type of original sound data which is transmittedfrom the channel ch1 is BGM(L), and the localization is −45 degrees. Inregard to original sound data which is transmitted from the channel ch5,the type is VO (voice), the localization is 0 degree, the reverberationis 0%, and the bit rate is 64 kbps.

As shown in FIG. 5, the processed control signal describes the timestamp corresponding to the control signal and the configuration ofprocessed sound data which is transferred by means of each channel foreach channel (L, R, SL, SR, and C). Specifically, the configurationrefers to the contents of the type, sound effect, and bit rate oforiginal sound allocated to each piece of processed sound data.

For example, in the processed control signal shown in FIG. 5( a), thetime stamp is t=0.0 second, the type of original sound data which istransmitted from the channel L is BGM(L) and SE (ambient sound), and thesound effect is 0%. In regard to original sound data which istransmitted from the channel SL, the type is SE (ambient sound), thesound effect is 12%, and the bit rate is 64 kbps.

1-5. Functional Configuration of Processing Unit

FIG. 6 is a diagram showing the functional configuration of theprocessing unit 152. The processing unit 152 functions as aninterpretation unit 1520, a synchronization unit 1521, a sound effectapplication unit 1523, and a localization processing unit 1524. Theinterpretation unit 1520 interprets the control signal generated by thecontrol signal generation unit 112. That is, the interpretation unit1520 reads the time stamp included in the control signal and sends thetime stamp to the synchronization unit 1521. The synchronization unit1521 searches for original sound data associated with a time stampcorresponding to the time stamp sent from the interpretation unit 1520or a time stamp indicating the time after the time indicated by the timestamp from among original sound data generated by the original sounddata generation unit 111. The original sound data is sequentially sentto the sound effect application unit 1523 and the localizationprocessing unit 1524.

The interpretation unit 1520 reads the parameters of the reverberationrate and the localization of original sound data transmitted from thechannels ch1 to ch5 from the control signal, and sends the parameters tothe sound effect application unit 1523 and the localization processingunit 1524.

The interpretation unit 1520 generates the processed control signal fromthe interpreted control signal and sends the processed control signal tothe audio processor 2.

The sound effect application unit 1523 acquires the reverberation rateof each piece of original sound data transmitted from the channels ch1to ch5 from the interpretation unit 1520, and performs reverberationprocessing at the reverberation rate. That is, the reverberation at thereverberation rate is applied to the original sound data to generatesound data (referred to as first processed sound data) indicating firstprocessed sound.

The localization processing unit 1524 acquires the localization of eachpiece of generated first processed sound data from the interpretationunit 1520, and sets the sound pressure of sound to be emitted in thesound emission device 3 such that a sound image is located at thelocalization when it is assumed that the sound emission device 3 has thestandard sound emission conditions. Accordingly, the localizationprocessing unit 1524 generates sound data (referred to as secondprocessed sound data) indicating second processed sound from the firstprocessed sound data.

The second processed sound data is packetized by the packet processingunit 151, and transmitted to the audio processor 2 through the sixchannels L, R, C, SL, SR, and SW based on the standard sound emissionconditions.

1-6. Configuration of Audio Processor

FIG. 7 is a diagram showing the configuration of the audio processor 2.A control unit 21 has a CPU, a ROM, and a RAM, and controls therespective units of the audio processor 2 using the CPU which reads andexecutes a boot loader stored in the ROM or a control program stored inthe storage unit 22 on the RAM. The control unit 21 includes a DSP(Digital Signal Processor) which corrects processed sound data (secondprocessed sound data) acquired through an acquisition unit 25.

A storage unit 22 is high-capacity storage means, such as a hard diskdrive, and stores a control program which is read into the control unit21. The storage unit 22 stores a correction content table 221. Thecorrection content table 221 is a table in which the contents ofcorrection processing for correcting processed sound data (secondprocessed sound data) processed according to the content of processingcorresponding to the standard sound emission conditions in the videogame machine 1 in accordance with the difference between the devicesound emission conditions of the sound emission device 3 to which theaudio processor 2 is connected and the standard sound emissionconditions are described.

The storage unit 22 may be a recording medium, such as an externalnonvolatile memory. In this case, the storage unit 22 is connected tothe audio processor 2 through a connection interface (not shown) or thelike.

An operation unit 23 includes an operator 231 which gives variousinstructions. The operation unit 23 receives user operation and suppliesan operation signal according to the operation content to the controlunit 21.

An acquisition unit 25 has a packet processing unit 251, and the packetprocessing unit 251 acquires a plurality of packets individually sentfrom the six channels L, R, C, SL, SR, and SW, extracts divided secondprocessed sound data from each acquired packet, and combines the dividedsecond processed sound data to acquire original second processed sounddata. That is, the acquisition unit 25 having the packet processing unit251 functions as a processed sound data acquirer that is adapted toacquire processed sound data, which is obtained by processing originalsound data according to the content of processing corresponding to thestandard sound emission conditions of the sound emission device, fromany channel of a plurality of channels. The time stamp included in theheader of the original packet is associated with the acquired secondprocessed sound data.

The acquisition unit 25 acquires the processed control signal outputfrom the output unit 15 of the video game machine 1. That is, theacquisition unit 25 functions as a control signal acquirer that isadapted to acquire control signal (processed control signal) whichincludes information indicating the configuration of processed sounddata obtained by processing original sound data by means of theparameter indicating the content of processing on original sound data.

A connection unit 24 includes a D/A converter 241 and an amplifier 242.The D/A converter 241 converts processed sound data generated by thecontrol unit 21 to analog data to acquire processed sound. The amplifier242 amplifies the acquired processed sound and transmits the processedsound to the six sound emission devices 3 (3L, 3R, 3C, 3SL, 3SR, 3SW)for sound emission. The connection unit 24 includes a detector 243 whichdetects the device sound emission conditions of the six sound emissiondevices 3 centering on the position of the user. Specifically, thedetector 243 detects the number of sound emission devices 3 which areconnected to the audio processor 2, the angle and distance of each soundemission device 3 with respect to the listening position of the user,and the sound range in which sound can be emitted by the sound emissiondevice 3. The device sound emission conditions of each sound emissiondevice 3 detected by the detector 243 are transferred to the controlunit 21. The detector 243 acquires test sound using a sound acquirer ata listening point to calculate the disposition of the speakers from thedelay time of the sound or the attenuation rate of the sound pressure oremits an infrared ray or the like toward a reflecting seal attached tothe speaker while revolving from the listening point to measure thedistance and angle, thereby detecting the direction in which eachspeaker is placed. The detector 243 may detect the device sound emissioncondition input in advance by user operation as the device soundemission conditions of the sound emission device 3.

The control unit 21 first acquires the device sound emission conditionsof the sound emission device 3 detected by the detector 243 of theconnection unit 24. Second, the control unit 21 acquires the secondprocessed sound data acquired by the acquisition unit 25 and theprocessed control signal which includes information indicating theconfiguration of the second processed sound data. Third, the controlunit 21 refers to the correction content table 221 of the storage unit22, and determines the contents of correction processing in accordancewith the difference between the acquired device sound emissionconditions and the standard sound emission condition, and the acquiredprocessed control signal. Fourth, the control unit 21 performscorrection processing based on the contents determined for the acquiredprocessed sound data.

1-7. Functional Configuration of Audio Processor

FIG. 8 is a diagram showing the functional configuration of mainly thecontrol unit 21 of the audio processor. The control unit 21 functions asan identification unit 210, a synchronization unit 211, a sound qualitycorrection unit 212, and a sound effect correction unit 213. Theidentification unit 210 acquires the processed control signal acquiredby the acquisition unit 25 and the device sound emission conditions ofthe sound emission device 3 detected by the detector 243 of theconnection unit 24. The identification unit 210 refers to the correctioncontent table 221 of the storage unit 22, and in order to make sound(hereinafter, referred to as second sound) emitted by the sound emissiondevice 3 under the acquired device sound emission conditions close tothe first sound, identifies the correction contents of the secondprocessed sound data based on the difference between the device soundemission conditions and the standard sound emission conditions, theprocessed control signal, and the second processed sound data acquiredin association with the sound emission device 3.

The correction content table 221 will be described. FIG. 9 is a tableshowing an example of the correction content table 221 which is storedin the storage unit 22. As shown in FIG. 9, the correction content table221 describes correction conditions which describe the conditions to bedetermined by the identification unit 210 in association with thecorrection contents identified when the identification unit 210determines that the correction conditions are satisfied. Accordingly,the identification unit 210 determines the conditions described in thecorrection conditions, and identifies the correction contents inaccordance with the determination result.

For example, the condition “lack” shown in FIG. 9 indicates thecondition that the sound emission device 3 which is present under thestandard sound emission conditions is lacking under the device soundemission conditions. At this time, as the correction content, “allocateto close sound emission device” of processed sound data is identified bythe identification unit 210. That is, the correction content becomesprocessing for allocating processed sound data allocated to the soundemission device 3, which is lacking under the device sound emissionconditions, to a different sound emission device 3 disposed close to thesound emission device 3 when viewed from a position where the soundemission device 3 should be present under the standard sound emissionconditions.

The condition “lack of sound range reproduction ability” shown in FIG. 9indicates the condition that, while the sound emission device 3 which ispresent under the standard sound emission conditions is present underthe device sound emission conditions, the sound emission device 3 underthe device sound emission conditions is lacking in reproduction abilityin any sound range compared to the sound emission device 3 under thestandard sound emission conditions. At this time, as the correctioncontent, “allocate to close sound emission device” of processed sounddata is identified by the identification unit 210. That is, thecorrection content becomes processing for allocating processed sounddata to a different sound emission device 3 close to the sound emissiondevice 3 only for a sound range in which reproduction ability is lackingunder the device sound emission conditions.

Returning to FIG. 7, the identification unit 210 reads the time stampincluded in the processed control signal and sends the time stamp to thesynchronization unit 211. The synchronization unit 211 searches for thesecond processed sound data associated with a time stamp correspondingto the time stamp sent from the identification unit 210 or a time stampindicating the time after the time indicated by the time stamp fromamong the second processed sound data acquired from the acquisition unit25 through the channels L, R, C, SL, SR, and SW. The second processedsound data is sequentially sent to the sound quality correction unit 212and the sound effect correction unit 213.

The identification unit 210 sends the identified correction contents tothe sound quality correction unit 212 and the sound effect correctionunit 213.

The sound quality correction unit 212 reads the configuration ofprocessed sound data from the processed control signal, and when the bitrate is lower than a threshold value, performs sound quality improvementprocessing according to the bit rate value on processed sound data.Accordingly, the sound quality correction unit 212 performs soundquality improvement processing on the second processed sound data togenerate sound data (referred to as third processed sound data)indicating third processed sound.

When the intensity of reverberation under the device sound emissionconditions of the sound emission device 3 detected by the detector 243is different from the intensity of reverberation under the standardsound emission conditions, the sound effect correction unit 213 removesor adds reverberation in accordance with the difference. For example,when the intensity of reverberation under the device sound emissionconditions is stronger than the intensity of reverberation under thestandard sound emission conditions, the reverberation applied in thevideo game machine 1 becomes excessive. Thus, in order to resolve anexcessive reverberation, the sound effect correction unit 213 removesthe reverberation applied to the third processed sound data inaccordance with a predetermined algorithm. On the contrary, when theintensity of reverberation under the device sound emission conditions isweaker than the intensity of reverberation under the standard soundemission conditions, the reverberation applied in the video game machine1 is insufficient. In this case, in order to resolve an insufficientreverberation, the sound effect correction unit 213 newly addsreverberation on the third processed sound data. In this way, the soundeffect correction unit 213 removes or adds the reverberation of thethird processed sound data to generate sound data (referred to as fourthprocessed sound data) indicating fourth processed sound.

The fourth processed sound data is transmitted from the connection unit24 to the sound emission devices 3 (3L, 3R, 3C, 3SL, 3SR, and 3SW)through the six channels L, R, C, SL, SR, and SW.

2. Operation

Next, the operation of the audio processing system 9 will be describedbased on the control signal shown in FIG. 4 as an example. The operationis divided into an operation relating to processing of original sounddata in the video game machine 1 and an operation relating to correctionof processed sound data in the audio processor 2.

2-1. Operation of Video Game Machine

The video game progression unit 110 reads a plurality of pieces of videodata and sound data from the storage unit 12 along the video gameprogram 121 to start the video game, and if the control signal shown inFIG. 4( a) is generated by the control signal generation unit 112, theprocessing unit 152 of the output unit 15 processes original sound datagenerated by the original sound data generation unit 111 based on theparameter included in the generated control signal to generate aplurality of pieces of processed sound data. The configuration of theprocessed sound data is as shown in the processed control signal of FIG.5( a).

For example, at the time of the start of the video game (that is,t=0.0), original sound which is transferred through the channel ch1 islocalized at an angle of 45 degrees from the user, and the reverberationof 12% is applied.

Next, when 2.5 seconds have elapsed from the start of the video game,the control signal shown in FIG. 4( b) is generated by the controlsignal generation unit 112. When receiving the control signal, the audioprocessor 2 searches for and processes each piece of original sound dataat t=2.5. A portion indicated by a thick frame in FIG. 4( b) is aportion which is changed from the control signal at t=0.0. Specifically,the localization and reverberation rate of the channel ch3 and thelocalization of the channel ch5 are changed. Accordingly, for example,at the time of t=2.5 seconds, original sound which is transferredthrough the channel ch3 is localized at an angle of 30 degrees from theuser, and the reverberation of 12% is applied. The configuration of theprocessed sound data is as shown in the processed control signal of FIG.5( b).

Next, when 10.0 seconds have elapsed from the start of the video game,the control signal shown in FIG. 4( c) is generated by the controlsignal generation unit 112. Here, the video game machine 1 istemporarily in a state where operation to move the game character is notreceived from the operation unit 13. For example, for the time forexplaining the story in the video game or the standby time for loadingthe video game program 121 corresponding to the next stage, the videogame machine 1 does not receive any operation excluding operation on thevideo game system, such as operation for force-quit, and BGM is playedwhen a motion image or a letter screen is displayed on the display unit14. At this time, since the game character on the video game does nothave a talk, as shown in FIG. 5( b), the channel SL heretofore allocatedto “VO” as voice is empty. Accordingly, the video game progression unit110 allocates BGM to all of the channels L, R, SL, and SR as shown inFIG. 5( c), and allocates system sound (SYS), which is generated whenthere is operation on the video game system, to the channels L and R.

The output unit 15 transmits a plurality of pieces of processed sounddata generated in the above-described manner and the control signal usedfor processing the processed sound data to the audio processor 2.

As described above, since the video game machine 1 outputs the processedsound data processed such that the first sound is emitted under thestandard sound emission conditions and the processed control signalwhich includes information indicating the configuration of the processedsound data, the audio processor 2 which receives the processed sounddata and the processed control signal can identify the configuration ofthe processed sound data. The audio processor 2 can identify thecorrection contents necessary for processed sound data based on thedifference between the actual device sound emission conditions and thestandard sound emission conditions such that the first sound is emittedto the sound emission device having the device sound emissionconditions.

Even when the audio processor 2 cannot identify the correction contentsfrom data acquired from the video game machine 1, the video game machine1 processes original sound data such that the first sound is emittedunder the standard sound emission conditions. Accordingly, when thedevice sound emission conditions of the sound emission device 3connected to the audio processor 2 are close to the standard soundemission conditions, the video game machine 1 just supplies processedsound data having not been corrected by the audio processor 2 to thesound emission device 3, thereby allowing sound close to the first soundto be emitted to the sound emission device 3. That is, the average soundemission conditions from among a plurality of sound emission devices 3are determined and defined as the standard sound emission conditions,thereby suppressing shift in processed sound data based on thedifference from the device sound emission conditions.

The video game machine 1 may be connected to a plurality of audioprocessors 2. In this case, even when the sound emission device 3connected to each audio processor 2 differs under the device soundemission conditions, processed sound data output from the video gamemachine 1 is corrected in each audio processor 2 in accordance with thedevice sound emission conditions. Accordingly, it is not necessary thatthe video game machine 1 individually generates and outputs processedsound data processed according to different contents of processing to aplurality of audio processors 2.

2-2. Operation of Audio Processor

When the processed control signal is received from the video gamemachine 1, the control unit 21 of the audio processor 2 searches foreach piece of processed sound data reconstructed from the packetcorresponding to the time stamp of the processed control signal,determines the content of correction processing based on the correctioncontent table 221 stored in the storage unit 22 and the processedcontrol signal, and corrects each piece of processed sound data.

FIG. 10 is a diagram illustrating the outline of correction processing.A black circle shown in FIG. 10( a) indicates the disposition of thesound emission device 3 under the standard sound emission conditions,and a broken line indicates the actual disposition of the sound emissiondevice 3. For example, as shown in FIG. 10( a), the device soundemission conditions of the sound emission device 3 connected to theaudio processor 2 are different from the standard sound emissionconditions depending on the shape or size of a room. A solid line shownin FIG. 10( b) indicates reproduction ability for the sound range of thesound emission device 3C under the standard sound emission conditions,and a broken line indicates reproduction ability for the sound range ofthe sound emission device 3C under the actual device sound emissionconditions. That is, in regard to the ability of each sound emissiondevice 3, the actual device sound emission conditions may be differentfrom the standard sound emission conditions. The audio processor 2corrects the acquired processed sound data so as to compensate for thedifference between the actual device sound emission conditions and thestandard sound emission conditions, and emits sound to the soundemission device 3 based on processed sound data after correction.

A specific example of correction processing will be described below.

(1) Presence/Absence of Sound Emission Device 3

Although in the standard sound emission conditions, the sound emissiondevice 3 (3L, 3R, 3C, 3SL, 3SR, and 3SW) corresponding to the sixchannels L, R, C, SL, SR, and SW are defined, all of the six soundemission devices 3 may not be actually used, or seven or more soundemission devices may be present. The correction content table 221 storedin the storage unit 12 describes the content of correction processingfor allocating processed sound data for emitting sound to the soundemission device 3C to the sound emission device 3L and the soundemission device 3R such that the sound image of processed soundindicated by the processed sound data is localized at a position wherethe sound emission device 3C is supposed to be present under thestandard sound emission conditions, for example, when the sound emissiondevice 3C which expresses a sound source from the front center under thestandard sound emission conditions is not present in the actuallyconnected sound emission devices 3.

Accordingly, if the detector 243 of the connection unit 24 detects thatthe sound emission device 3C is not present, the control unit 21references the correction content table 221, and the processing unit 152allocates processed sound data allocated to the sound emission device 3C(that is, the channel C) to the sound emission device 3L and the soundemission device 3R, sets the sound pressure of processed sound indicatedby each piece of processed sound data, and emits sound. The set soundpressure is 50% of the sound pressure of processed sound which will beintrinsically emitted in the sound emission device 3C. The ratio of thesound pressure or the like is determined based on the processed controlsignal.

When there is no surround speaker (the sound emission device 3SL and thesound emission device 3SR), similarly, the control unit 21 allocatesprocessed sound data of processed sound, which will be emitted to thesound emission device 3SL and the sound emission device 3SR, to thesound emission device 3L and the sound emission device 3R as correctionprocessing. The ratio of the sound pressure or the like of processedsound indicated by the processed sound data is determined based on theprocessed control signal.

When there is no subwoofer (the sound emission device 3SW), the controlunit 21 allocates processed sound data of processed sound, which will beemitted to the sound emission device 3SW, to the sound emission device3L and the sound emission device 3R as correction processing. At thistime, the detector 243 detects the low-frequency reproduction ability ofthe sound emission device 3L and the sound emission device 3R, and if itis determined that the degree of influence on the emission of processedsound is low, omits the emission of processed sound or sets a low soundpressure.

(2) Ability of Sound Emission Device 3

The detector 243 detects the ability of each sound emission device 3 andtransfers the content to the control unit 21. For example, it is assumedthat, by comparison with a threshold value set in advance, the detector243 detects that the sound emission device 3R has sufficientlow-frequency reproduction ability, and detects that the sound emissiondevice 3SR does not have low-frequency reproduction ability. Here, iforiginal sound data is processed by the processing unit 152 such thatthe user feels that the sound image of any type of original sound ismoving from the position of the sound emission device 3R to the positionof the sound emission device 3SR under the standard sound emissionconditions, the control unit 21 divides processed sound data transmittedthrough the channel SR for each range through a filter, such as ahigh-pass filter or a low-pass filter with the movement of the soundimage with reference to the processed control signal, and correctsprocessed sound data such that processed sound in the middle-high rangefrom among processed sound indicated by the divided processed sound datais emitted to the sound emission device 3SR, and processed soundcorresponding to a low-frequency component is emitted to the soundemission device 3SW. Instead of performing the division processing,sound emission using the sound emission device 3SW may not be performed.

The control unit 21 identifies the difference between the ability ofeach sound emission device 3 under the standard sound emissionconditions and the ability of each sound emission device 3 under thedevice sound emission conditions, and performs corresponding soundquality improvement processing or sound effect application. For example,when the detector 243 acquires test sound emitted to each sound emissiondevice 3 using sound acquisition means, and detects “intensity ofreverberation” which is one of the ability of each sound emission device3, the control unit 21 compares the intensity of reverberation with theintensity of reverberation defined in advance under the standard soundemission conditions, and when the intensity of reverberation under thedevice sound emission conditions is stronger than the intensity ofreverberation under the standard sound emission conditions, performsprocessing for removing the reverberation of processed sound dataapplied through processing in the video game machine 1. On the contrary,when the intensity of reverberation under the device sound emissionconditions is weaker than the intensity of reverberation under thestandard sound emission conditions, the control unit 21 performsprocessing for adding reverberation to processed sound data acquiredfrom the video game machine 1. Accordingly, deviation in the soundeffect which occurs depending on whether the reverberation in an actualroom is greater or smaller than a virtual room which is supposed asstandard is reduced.

(3) Disposition of Sound Emission Device 3

For example, when the front for the user at the listening position is 0degree, and the disposition of each sound emission device 3 isrepresented by an increasing angle in the counterclockwise directionfrom above the head of the user, it is assumed that, under the standardsound emission conditions, the sound emission device 3C is disposed at 0degree, and the sound emission device 3L is disposed at 45 degrees.Here, if the control signal is provided to localize any original soundat 30 degrees, the localization is between the sound emission device 3Cand the sound emission device 3L, and closer to the sound emissiondevice 3L than the sound emission device 3C. For this reason, the videogame machine 1 generates processed sound data such that the originalsound is emitted to the sound emission device 3L at a higher soundpressure (for example, two times) than the sound emission device 3C.

Here, it is assumed that the detector 243 detects that the actual soundemission device 3C is disposed at 0 degree, and the actual soundemission device 3L is disposed at 60 degrees. When this happens, sincethe angle at which the control signal will localize original sound is 30degrees, this is just the middle between the actual sound emissiondevice 3C and the sound emission device 3L. Nevertheless, if processedsound data generated by the video game machine 1 is used as it is, theabove-described original sound is emitted to the sound emission device3L at a higher sound pressure than the sound emission device 3C, suchthat the original sound is localized at a position of an angle greaterthan a position where the original sound will be localized. Accordingly,as correction processing, the control unit 21 corrects processed sounddata such that the sound pressure of processed sound emitted by thesound emission device 3C and the sound emission device 3L becomes equal.

For example, when the video game machine executes video game software,such as a role-playing game, a game character, words which are spoken bythe game character, how sound echoes, and the direction in which soundis heard change depending on the progress of the video game, such asselection of a member who goes with the game character, selection of adungeon, or selection of the direction of the face of the gamecharacter. There are various ways to listen sound depending on the typeof the sound, and the ways to listen sound change depending on theactual device sound emission conditions of the sound emission device.Accordingly, if a sound effect is applied without exception at a stagewhere the device sound emission conditions under which sound is emittedare not known, unintended sound may be heard by the user in the actualsound emission device. However, since an information processor, such asa video game machine, which reproduces software or contents should emitsound included in the contents under various device sound emissionconditions, in general, data indicating the sound is processed based onthe standard sound emission conditions without exception and output tothe audio processor. For this reason, when the device sound emissionconditions of the sound emission device connected to the audio processorare apart from the standard sound emission conditions, sound to beemitted may be affected.

In the audio processing system 9, as described above, processed sounddata which is data after processing and the control signal whichincludes information indicating the configuration of the processed sounddata are sent to the audio processor 2, and the audio processor 2corrects processed sound data based on the corresponding parameter andthe difference between the device sound emission conditions of theconnected sound emission device and the standard sound emissionconditions, thereby reducing the effect on sound emission due to thedifference.

3. Modifications

Although the embodiment has been described, the content of theembodiment may be modified as follows. Further, the followingmodifications may be combined.

(1) Although in the foregoing embodiment, the output unit 15 transmitsprocessed sound data as PCM data to the channels L, R, C, SL, SR, andSW, compressed, processed sound data may be transmitted. In this case,the control signal may include information indicating a compressionformat or a compression rate of compression processing on original sounddata transmitted through each channel.

(2) Although in the foregoing embodiment, the output unit 15 packetizesprocessed sound data processed by the processing unit 152 using thepacket processing unit 151 as it is, encryption may be performed beforepacketization. For example, the output unit 15 may include a processorwhich performs encryption processing based on the HDCP (High-bandwidthDigital Content Protection) protocol, and the encryption function may berealized by the CPU. In this case, a mechanism for decrypting codes maybe provided in the acquisition unit 25 of the audio processor 2.

(3) Although in the foregoing embodiment, the control signal generationunit 112 generates the processed control signal in which the overallconfiguration of all pieces of processed sound data is described foreach time stamp, a processed control signal in which only theconfiguration with changes is described may be generated. That is, onlya portion indicated by a thick frame in FIGS. 4( b) and 4(c) may betransmitted as a processed control signal to the audio processor 2 inassociation with each time stamp. In this case, the audio processor 2may not change the channels and parameters not included in thetransmitted processed control signal.

(4) Although in the foregoing embodiment, the configuration in whichoriginal sound data is transmitted to the audio processor 2 is the videogame machine 1, a configuration other than the video game machine may beprovided. For example, a reproducer which reproduces a motion imagerecorded in a DVD video may be provided. In this case, the reproducerswitches video to be displayed in accordance with user operation, andswitches the processed control signal corresponding to each piece ofprocessed sound data to be transmitted to the audio processor 2 inaccordance with user operation. For example, when there is a video datacaptured at a multi-angle, the localization of sound (processed sound)which should be emitted may be obtained in accordance with an angleselected by the user, processed sound data according to the localizationmay be generated under the standard sound emission conditions, and theconfiguration of the generated processed sound data may be transmittedto the audio processor 2 along with the processed control signal. Theaudio processor 2 may correct processed sound data so as to adapt to thesound emission device 3 connected to the audio processor 2 withreference to the processed sound data, the processed control signal, thedevice sound emission conditions of the sound emission device 3 detectedby the detector 243, and the standard sound emission conditions.Accordingly, when it is assumed that the face of the user is directed atthe angle selected by the user, the audio processor 2 can increase thepossibility that the sound image approaches in the direction in whichsound should be heard.

(5) Although in the foregoing embodiment, processed sound data and thecontrol signal which is used to generate the processed sound data areoutput from the single video game machine 1, an information processor,such as the video game machine 1, may output processed sound data, andmay not output the corresponding processed control signal. In this case,the audio processor 2 may acquire the processed control signal from adevice other than the information processor.

FIG. 11 is a diagram showing an audio processing system 9 a according toa modification. The audio processing system 9 a has a reproducer 1 a, anaudio processor 2 a, a sound emission device 3, a network 4, and aserver device 5. The reproducer 1 a is a device which reproduces motionimage contents of a DVD video or the like. The reproducer 1 a functionsas an information processor including a generator that is adapted togenerate original sound data indicating original sound and a parameterindicating the content of processing on the original sound data inaccordance with user operation, a processed sound data generator that isadapted to process original sound data generated by the generatoraccording to the content of processing indicated by the parameter togenerate processed sound data, and a processed sound data output sectionthat is adapted to output processed sound data generated by theprocessed sound data generator from any channel of a plurality ofchannels. That is, the reproducer 1 a is the same as the video gamemachine 1 in the foregoing embodiment except that there is noconfiguration corresponding to a control signal output section that isadapted to output a control signal which includes information indicatingthe configuration of processed sound data obtained by processingoriginal sound data by means of a parameter indicating the content ofprocessing on original sound data, and when reproduction of a motionimage content starts, the identification information of the motion imagecontent is output to the audio processor 2 a. The sound emission device3 has the same configuration as the foregoing embodiment.

The audio processor 2 a is connected to the server device 5 through thenetwork 4. If the identification information of the motion image contentis received from the reproducer 1 a, the audio processor 2 a request theserver device 5 for a processed control signal defined in advance forthe motion image content identified by the received identificationinformation. The server device 5 transmits the requested processedcontrol signal to the audio processor 2 a in response to the request.The processed control signal describes information indicating theconfiguration of processed sound data obtained by processing originalsound data by means of the parameter indicating the correspondingcontent of processing under the standard sound emission conditions. Theaudio processor 2 a receives the processed control signal from theserver device 5, and identifies the processed control signalcorresponding to the progress of the motion image content with referenceto the time stamp attached to the processed control signal. The audioprocessor 2 a corrects processed sound data with reference to processedsound data output from the reproducer 1 a, the identified processedcontrol signal, the device sound emission conditions of the soundemission device 3 detected by the detector, and the standard soundemission conditions. Accordingly, as in the foregoing embodiment, theaudio processor 2 a can correct processed sound data processed by meansof the parameter indicating the corresponding content of processingunder the standard sound emission conditions close to processed sounddata when being processed based on the device sound emission conditionsof the sound emission device 3 connected to the audio processor 2 a.

(6) Each program which is executed in the control unit 11 of the videogame machine 1 and the control unit 21 of the audio processor 2 may beprovided in the form of being stored in a computer-readable recordingmedium, such as a magnetic recording medium, for example, a magnetictape or a magnetic disk, an optical recording medium, such as an opticaldisk, a magneto-optical recording medium, or a semiconductor memory. Theprogram may be downloaded through a network, such as Internet. In regardto the control unit 11 and the control unit 21, various devices otherthan the CPU may be applied as control means illustrated by the CPU, andfor example, a specialized processor or the like may be used.

(7) Although in the foregoing embodiment, the output unit 15 includesthe processing unit 152 which processes original sound data obtainedfrom the original sound data generation unit 111, a function ofprocessing original sound data may be realized by the control unit 11which executes the above-described program.

(8) Although in the foregoing embodiment, the video game machine 1 hasthe display unit 14 which displays video according to the progress ofthe video game, the video game machine 1 may not have the display unit14. For example, the video game machine 1 may execute video gamesoftware which deals with sound and does not display video, or mayinclude a video terminal which is connected to an external displaydevice and through which a video signal is supplied to a display device.

(9) Although in the foregoing embodiment, the audio processing system 9includes the six sound emission devices 3, and realizes so-called 5.1 chsurround sound emission, more sound emission devices 3 or less soundemission devices 3 may be provided. For example, the sound emissiondevices 3 may be provided to correspond to the 7.1 ch system or the 2.1ch system.

(10) Although in the foregoing embodiment, the control signal generationunit 112 generates the parameter indicating the content of processing onoriginal sound data according to the progress of the video game, theparameter may be generated based on information acquired from the audioprocessor 2. In this case, the control unit 11 of the video game machine1 has channels (hereinafter, referred to as acquisition channels)through which data is acquired from the audio processor 2, as well asthe channels through which data is output to the audio processor 2, thecontrol unit 11 acquires the device sound emission conditions, such asthe number of sound emission devices 3 connected to the audio processor2, the position, or low-frequency reproduction ability, through theacquisition channels. That is, the control unit 11 functions as a soundemission condition acquirer that is adapted to acquire the soundemission conditions of the sound emission device, which is forced toemit sound by the audio processor, from the audio processor as an outputdestination to which the processed sound data output means outputsprocessed sound data.

The control signal generation unit 112 may determine the content ofprocessing according to the sound emission conditions acquired from theacquisition channels, and may generate the parameter. The processingunit 152 may acquire the parameter generated by the control signalgeneration unit 112, may process each piece of original sound datagenerated by the original sound data generation unit 111 based on theacquired parameter, and may generate a plurality of pieces of processedsound data.

In this case, the audio processor 2 transmits a signal indicating thedevice sound emission conditions of the sound emission device 3 detectedby the detector 243 to the video game machine 1 through the acquisitionchannels. When processed sound data acquired by the acquisition unit 25of the audio processor 2 is obtained by processing original sound dataaccording to the content of processing defined such that the first soundis emitted under the device sound emission conditions indicated by thesignal by the processing unit 152 of the video game machine 1 whichreceives the signal, the control unit 21 may not determine the contentof correction processing on the processed sound data and may not performcorrection processing. As a result, the control unit 21 may supplyuncorrected processed sound data from the connection unit 24 to eachsound emission device 3.

The determination on whether or not the acquired processed sound data isprocessed according to the content of processing defined such that thefirst sound is emitted under the device sound emission conditions may bemade based on, for example, the processed control signal acquired by theacquisition unit 25. In this case, when the processing unit 152 of thevideo game machine 1 generates the processed sound data by processingoriginal sound data according to the content of processing defined suchthat the first sound is emitted under the device sound emissionconditions indicated by the signal transmitted from the audio processor2, the processing unit 152 may include flag information indicating theeffect in the processed control signal associated with the processedsound data. Accordingly, when the flag information is included in theprocessed control signal acquired by the acquisition unit 25, thecontrol unit 21 of the audio processor 2 may determine that processedsound data associated with the processed control signal is processedaccording to the content of processing defined such that the first soundis emitted under the device sound emission condition, and may performcorrection processing on the processed sound data.

(11) Although in the foregoing embodiment, the video game progressionunit 110 progresses the video game according to user operation along thevideo game program 121, the content of the video game program 121 maybe, for example, as follows.

The video game program 121 describes a virtual space, and a gamecharacter and a sound generating object which are disposed in thevirtual space. Data which expresses the virtual space, the gamecharacter, and the sound generating object is stored on the RAM of thecontrol unit 11 when the video game program 121 is read by the controlunit 11 and executed. If user operation is received, the video gameprogression unit 110 performs calculation according to the operation tochange data on the RAM. Accordingly, the game character in the virtualspace is operated in accordance with user operation, and the video gameis progressed. The operated game character takes a posture according touser operation in the virtual space or moves to a position according tothe operation.

For a game character which is disposed in the virtual space, thelistening position where sound emitted in the virtual space is heard isdefined. The original sound data generation unit 111 calculates andgenerates original sound data indicating original sound set for a soundgenerating object from the relationship between the listening positiondefined for the game character and the sound generating object disposedin the virtual space. The processing unit 152 of the output unit 15generates a plurality of pieces of processed sound data according to theprogress of the video game by processing a plurality of pieces oforiginal sound data calculated and generated by the original sound datageneration unit 111. The packet processing unit 151 of the output unit15 packetizes the generated processed sound data and outputs the packetsto the audio processor 2 by means of the individual channels. Thecontrol signal generation unit 112 generates a control signal whichincludes a parameter indicating the content of processing of each pieceof original sound data in association with the identificationinformation of each piece of original sound data. The parameter isdetermined in accordance with the progress of the video game and useroperation, and how the user listens to original sound indicating theoriginal sound data by means of the parameter is designated. The outputunit 15 outputs the generated control signal to the audio processor 2.

(12) Although in the foregoing embodiment, the number of pieces oforiginal sound data which are generated simultaneously by the originalsound data generation unit 111 is a maximum of five, the number ofpieces of original sound data may be equal to or smaller than four, orequal to or greater than six.

(13) Although in the foregoing embodiment, the processing unit 152 ofthe video game machine 1 generates information indicating theconfiguration of processed sound data obtained by processing originalsound data by means of the parameter acquired from the control signalgeneration unit 112, and outputs the processed control signal includingthe information to the audio processor 2 through the packet processingunit 151, the processed control signal may not be output to the audioprocessor 2. In this case, the audio processor 2 may acquire the controlsignal generated by the control signal generation unit 112 instead ofthe processed control signal.

FIG. 12 is a diagram showing the functional configuration of the videogame machine 1 according to the modification. FIG. 13 is a diagramshowing the functional configuration of the processing unit 152according to the modification. In this way, the control signal generatedby the control signal generation unit 112 is supplied to the processingunit 152 and used to process original sound data, and is output to theaudio processor 2 through the packet processing unit 151 without beingchanged to the processed control signal. Since the control signalincludes the parameter indicating the content of processing on originalsound data according to the progress of the video game, the control unit21 can more accurately identify the correction contents of processedsound data.

For example, when there is the difference between the disposition underthe device sound emission conditions of the sound emission device 3detected by the detector 243 and the disposition under the standardsound emission condition (there is misalignment), the control unit 21adjusts the sound pressure of sound emission in the sound emissiondevice 3 in accordance with the difference. For example, when theposition of the sound emission device 3 under the device sound emissionconditions is closer to a localization set for any sound image than theposition of the sound emission device 3 under the standard soundemission conditions, the control unit 21 increases the sound pressure ofthe sound emission device 3. On the contrary, when the position isapart, the control unit 21 decreases the sound pressure of the soundemission device 3. Accordingly, deviation in sound image localizationdue to misalignment is suppressed.

(14) Although in the foregoing embodiment, the identification unit 210which is the function to be realized by the control unit 21 of the audioprocessor references the correction content table 221 of the storageunit 22, and identifies the correction contents of processed sound datasuch that the second sound emitted by the sound emission device 3 underthe acquired device sound emission conditions is close to the firstsound determined on the video game machine 1 side, the correctioncontents may be identified so as to make the second sound close to thethird sound determined on the audio processor 2 side. Similarly to thefirst sound, the term “third sound” means sound designated about how theuser listens to original sound indicated by original sound data, and hasa clear difference from the first sound. Information which designatesthe third sound may be determined by user operation on the operationunit 23 of the audio processor 2 or may be stored in the storage unit 22in advance. That is, in the foregoing embodiment, as an example of thethird sound, the first sound determined on the video game machine 1 sideis set (that is, there is no difference from the first sound).

Processed sound data acquired through the acquisition unit 25 isprocessed by the video game machine 1 such that the first sound isemitted under the standard sound emission conditions, and the audioprocessor 2 acquires the processed control signal or the control signal,thereby identifying the content of processing in the video game machine1. Accordingly, the identification unit 210 can use the differencebetween the third sound determined on the audio processor 2 side and thefirst sound determined on the video game machine 1 side. That is, theidentification unit 210 can identify the correction contents to correctthe processed sound data directly close to the third sound based on thedifference between the device sound emission conditions and the standardsound emission conditions, the processed control signal (or the controlsignal), and processed sound data acquired in association with the soundemission device 3.

Reference Signs List

1: video game machine, 1 a: reproducer, 11: control unit, 110: videogame progression unit, 111: original sound data generation unit, 112:control signal generation unit, 12: storage unit, 121: video gameprogram, 13: operation unit, 131: operator, 14: display unit, 15: outputunit, 151: packet processing unit, 152: processing unit, 1520:interpretation unit, 1521: synchronization unit, 1523: sound effectapplication unit, 1524: localization processing unit, 2, 2 a: audioprocessor, 21: control unit, 210: identification unit, 211:synchronization unit, 212: sound quality correction unit, 213: soundeffect correction unit, 22: storage unit, 221: correction content table,23: operation unit, 231: operator, 24: connection unit, 241: D/Aconverter, 242: amplifier, 243: detector, 25: acquisition unit, 251:packet processing unit, 3, 3C, 3L, 3R, 3SL, 3SR, 3SW: sound emissiondevice, 4: network, 5: server device, 9, 9 a: audio processing system

The invention claimed is:
 1. An audio processor connectable to a soundemission device that emits a sound according to supplied data, the audioprocessor comprising: an acquisition unit having an interface configuredto acquire: processed sound data, which is original sound data havingbeen processed according to a content of processing defined so thatdetermined first sound is emitted under a standard sound emissioncondition, wherein the processed sound data is acquired in associationwith the sound emission device; and a control signal including at leastone of a parameter indicating the content of processing on the originalsound data or information indicating a configuration of the processedsound data corresponding to the original sound data processed using theparameter; a connection unit having a detector configured to detect adevice sound emission condition of the sound emission device connectedto the audio processor; and a control unit connected to a memory andconfigured to execute: a sound emission condition acquiring task thatacquires, from the connection unit, the device sound emission conditionbased on the detected device sound emission condition from the detector;a processed sound data acquiring task that acquires the processed sounddata from the acquisition unit; a control signal acquiring task thatacquires the control signal from the acquisition unit; an identifyingtask that identifies a correction content of the processed sound databased on (i) a difference between the acquired device sound emissioncondition and the standard sound emission condition, (ii) the controlsignal acquired by the control signal acquiring task, and (iii) theprocessed sound data acquired in association with the sound emissiondevice by the processed sound data acquiring task to generate a secondsound, which is to be emitted by the sound emission device under theacquired device sound emission condition, close to the determined firstsound or a third sound defined to be different from the determined firstsound; a correction task that corrects the processed sound dataaccording to the correction content identified by the identifying task;and a supplying task that supplies the processed sound data corrected bythe correcting task to the sound emission device via the connectionunit.
 2. The audio processor according to claim 1, wherein theacquisition unit is further configured to: acquire identificationinformation of the original sound data; and transmit the acquiredidentification information of the original sound data to an externaldevice, and acquire the control signal including at least one of theparameter of the original sound data indicated by the identificationinformation or information indicating a configuration of the processedsound data corresponding to the original sound data processed by theexternal device using the parameter.
 3. The audio processor according toclaim 1, wherein: the acquisition unit is further configured to transmita signal indicating the acquired device sound emission condition to aninformation processor that provides the processed sound data to acquirethe processed sound data, the supplying task supplies uncorrectedprocessed sound data to the sound emission device without correcting theprocessed sound data by the correction task when the processed sounddata acquired by the acquisition unit is processed sound datacorresponding to the original sound data processed by the informationprocessor according to the content of processing defined so that thedetermined first sound is emitted based on the transmitted signalindicating the acquired device sound emission condition transmitted bythe acquisition unit.
 4. An audio processing system comprising: a soundemission device that emits a sound according to supplied data; aninformation processor; and an audio processor connectable to the soundemission device, and includes: an acquisition unit having an interfaceand configured to acquire: processed sound data, which is original sounddata having been processed according to a content of processing definedso that determined first sound is emitted under a standard soundemission condition, wherein the processed sound data is acquired inassociation with the sound emission device; and a control signalincluding at least one of a parameter indicating the content ofprocessing on the original sound data or information indicating aconfiguration of the processed sound data corresponding to the originalsound data processed using the parameter; a connection unit having adetector configured to detect a device sound emission condition of thesound emission device connected to the audio processor; and a firstcontrol unit connected to a first memory and configured to execute: asound emission condition acquiring task that acquires, from theconnection unit, the device sound emission condition based on thedetected device sound emission condition from the detector; a processedsound data acquiring task that acquires the processed sound data fromthe acquisition unit; a control signal acquiring task that acquires thecontrol signal from the acquiring unit; an identifying task thatidentifies a correction content of the processed sound data based on (i)a difference between the acquired device sound emission condition andthe standard sound emission condition,(ii) the control signal acquiredby the control signal acquiring task, and (iii) the processed sound dataacquired in association with the sound emission device by the processedsound data acquiring task to generate a second sound, which is to beemitted by the sound emission device under the acquired device soundemission condition, close to the determined first sound or a third sounddefined to be different from the determined first sound; a correctiontask that corrects the processed sound data according to the correctioncontent identified by the identifying task; a supplying task thatsupplies the processed sound data corrected by the correcting task tothe sound emission device via the connection unit, wherein theinformation processor includes: a second control unit having a secondmemory and configured to generate original sound data indicatingoriginal sound and a parameter indicating a content of processing on theoriginal sound data in accordance with user operation; an output unithaving an interface configured to communicate data to an externalapparatus, and configured to: process the original sound data generatedby the control unit according to the content of processing indicated bythe parameter to generate processed sound data; output the processedsound data to the external device; and outputs the control signalincluding at least one of the parameter indicating the content ofprocessing on the original sound data or information indicating aconfiguration of the processed sound data to the external device.
 5. Anon-transitory computer-readable storage medium storing a programexecutable by an audio processor connectable to a sound emission devicethat emits a sound according to supplied data and having an acquisitionunit having an interface configured to acquire processed sound data, aconnection unit having a detector configured to detect a device soundemission condition of the sound emission device connected to the audioprocessor, and a control unit connected to a memory, the program beingexecutable by the control unit to execute a method comprising: a soundemission condition acquiring step of acquiring, from the connectionunit, the device sound emission condition based on the detected devicesound emission condition from the detector; a processed sound dataacquiring step of acquiring, from the acquiring unit, the processedsound data, which is original sound data having been processed accordingto a content of processing defined so that determined first sound isemitted under a standard sound emission condition, wherein the processedsound data is acquired in association with the sound emission device; acontrol signal acquiring step of acquiring, from the acquiring unit, acontrol signal including at least one of a parameter indicating thecontent of processing on the original sound data or informationindicating a configuration of the processed sound data corresponding tothe original sound data processed using the parameter; an identifyingstep of identifying a correction content of the processed sound databased On (i) a difference between the acquired device sound emissioncondition and the standard sound emission condition, (ii) the controlsignal acquired in the control signal acquiring step, and (iii) theprocessed sound data acquired in association with the sound emissiondevice in the processed sound data acquiring step to generate a secondsound, which is to be emitted by the sound emission device under theacquired device sound emission condition, close to the determined firstsound or a third sound defined to be different from the determined firstsound; a correction step of correcting the processed sound dataaccording to the correction content identified in the identifying step;and a supplying step of supplying the processed sound data corrected bythe correcting step to the sound emission device via the connectionunit.